<i>Learning to Fly</i>: A Distributed Deep Reinforcement Learning Framework for Software-Defined UAV Network Control

نویسندگان

چکیده

Control and performance optimization of wireless networks Unmanned Aerial Vehicles (UAVs) require scalable approaches that go beyond architectures based on centralized network controllers. At the same time, model-based is often limited by accuracy approximations relaxations necessary to solve UAV control problem through convex or similar techniques, channel models used. To address these challenges, this article introduces a new architectural framework optimize Deep Reinforcement Learning (DRL). Furthermore, it proposes virtualized, `ready-to-fly' emulation environment generate extensive data traces train DRL algorithms, which are notoriously hard collect battery-powered networks. The training integrates previously developed protocol stacks for UAVs into CORE/EMANE tool. Our virtual guarantees collection high-fidelity can be used agents. proposed architecture enables distributed data-driven (with up 3.7 × throughput improvement 0.2 latency reduction in reported experiments), facilitates reconfiguration, provides solution large

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Neural Network Based Protection of Software Defined Network Controller against Distributed Denial of Service Attacks

Software Defined Network (SDN) is a new architecture for network management and its main concept is centralizing network management in the network control level that has an overview of the network and determines the forwarding rules for switches and routers (the data level). Although this centralized control is the main advantage of SDN, it is also a single point of failure. If this main contro...

متن کامل

Ovid: A Software-Defined Distributed Systems Framework

We present Ovid, a framework for building evolvable large-scale distributed systems that run in the cloud. Ovid constructs and deploys distributed systems as a collection of simple components, creating systems suited for containerization in the cloud. Ovid supports evolution of systems through transformations, which are automated refinements. Examples of transformations include replication, bat...

متن کامل

A Deep-Reinforcement Learning Approach for Software-Defined Networking Routing Optimization

In this paper we design and evaluate a Deep-Reinforcement Learning agent that optimizes routing. Our agent adapts automatically to current traffic conditions and proposes tailored configurations that attempt to minimize the network delay. Experiments show very promising performance. Moreover, this approach provides important operational advantages with respect to traditional optimization algori...

متن کامل

Deep Reinforcement Learning framework for Autonomous Driving

Reinforcement learning is considered to be a strong AI paradigm which can be used to teach machines through interaction with the environment and learning from their mistakes. Despite its perceived utility, it has not yet been successfully applied in automotive applications. Motivated by the successful demonstrations of learning of Atari games and Go by Google DeepMind, we propose a framework fo...

متن کامل

A Multi-Objective Deep Reinforcement Learning Framework

This paper presents a new multi-objective deep reinforcement learning (MODRL) framework based on deep Q-networks. We propose linear and non-linear methods to develop the MODRL framework that includes both single-policy and multi-policy strategies. The experimental results on a deep sea treasure environment indicate that the proposed approach is able to converge to the optimal Pareto solutions. ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE open journal of the Communications Society

سال: 2021

ISSN: ['2644-125X']

DOI: https://doi.org/10.1109/ojcoms.2021.3092690